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BACKGROUND OF THE INVENTION 

5 [0001] The present invention relates to post-processing of decompressed digital jmages and, more particularly, to a 
method of directional, selective filtering of decompressed images. 

[0002] Transform coding is a common method for compressing digital images. For examples, transform coding is 
featured in the JPEG (ISO 1091 8) standard related to still images and the MPEG-2 (ISO/IEC 13818) standard related 
to motion video. Generally, transform coding involves subdividing an image into smaller blocks or groups of pixels, 

10 applying a "reversible transform" (such as the Discrete Cosine Transform (DCT)) to the pixels of the blocks, quantizing 
the frequency coefficients produced by the transform, and coding of the results. While transform coding can achieve 
a high compression ratio, information in the original image is discarded in the compression-decompression process 
degrading the decompressed image, especially in video sequences with considerable motion. 
[0003] Decompressed transform coded images may include visible artifacts of the compression-decompression proc- 

15 ess. A common artifact is the "blocking" effect, also known as "grid noise." The blocking effect is the result of the 
process of approximating each of the frequency coefficients produced by the transform as one of a limited number of 
permitted values during the quantization step. The encoder selects a quantization parameter establishing the difference 
between successive permitted values and assigns each frequency coefficient to the nearest permitted value. As a 
result of the "rounding off" during quantization, adjacent pixels may have different quantized values even though their 

20 colors were nearly the same in the original image causing individual blocks to be visible in the decompressed image. 
This is a particular problem in areas of uniform color and along color boundaries. In addition, the decompressed image 
may exhibit "staircase noise," a term which is descriptive of an appearance of an edge in the image. The staircase 
appearance is the result of enhancement of the blocking effect for blocks lying across an edge in an image. A third 
artifact of interest in decompressed images is the so called "ringing artifact" that produces jagged or fuzzy lines in the 

25 vicinity of sharp edges. All of these artifacts can be annoying to viewers of the image. Accordingly, images are processed 
after decompression (post-processed) to reduce or eliminate some or all of these artifacts. 

[0004] Several methods have been used to remove or reduce annoying artifacts in decompressed images. Some 
methods attempt to recover the original image from the decompressed image and knowledge of the smoothness prop- 
erties of the image before compression. Generally, these methods are complex and often iterative limiting their use- 

30 fulness in real time video applications. 

[0005] Filtering may also be applied to the image pixels to reduce artifacts of the compression process. For example, 
filtering may be applied to pixel segments of rows or columns normal to the block boundaries to smooth the color or 
grayscale transition across the boundary, thereby reducing the blocking effect. Classification of the block's neighbor- 
hood and filtering based on the dassification can be part of the filtering process. While filtering pixel segments normal 

35 to block boundaries is useful in addressing the blocking effect, it does not necessarily address ringing artifacts. Further, 
edges may be filtered and some portions of diagonal edges may be filtered repeatedly, adversely impacting the sharp- 
ness of the decompressed image. 

[0006] What is desired, therefore, is a computationally conservative method of post-processing a decompressed 
image that effectively addresses both blocking and ringing artifacts but preserves the sharpness of edges in the image. 

40 

SUMMARY OF THE INVENTION 

[0007] The present invention overcomes the aforementioned drawbacks of the prior art by providing a method of 
post-processing a decompressed image comprising the steps of establishing a filtering axis aligned relatively parallel 

45 to an image edge in a block of image pixels and selectively filtering a plurality of pixels arrayed substantially parallel 
to the filtering axis. Filtering the pixels of a block in a direction substantially parallel to an image edge in the block 
minimizes any impact on the sharpness of the edge. Further, the method conserves computational resources by se- 
lecting pixels for filtering that exhibit a difference from their neighbors that is likely to produce a visual artifact Pixels 
that are members of blocks not likely to exhibit a blocking effect are not filtered. Further, pixels at block boundaries 

50 having values sufficiently close so as not to produce a noticeable artifact and pixels representing details are not filtered. 
v The method can also be applied separately to the images contained in individual fields of interlaced video to avoid 
image complications arising from the separate processing, including compression, of the fields. 
[0008] The foregoing and other objectives, features and advantages of the invention will be more readily understood 
upon consideration of the following detailed description of the invention, taken in conjunction with the accompanying 

55 drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] 

5 FIG. 1 is a schematic drawing of pixels of an exemplary area of a decompressed image. 
FIG. 2 is a flow diagram of the post-processing method of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

w [0010] In the transform coding process an N (pixel) x N (pixel) image is subdivided into nxn sub-images or blocks 
and the transform is applied to the individual pixels on a block by block basis. For example, in the Discrete Cosine 
Transform (DCT) compression process utilized by in the JPEG (ISO 10918) and MPEG-2 (ISO/IEC 13818) image 
compression processes the image is subdivided into 8X8 blocks for coding. FIG. 1 illustrates a portion of a larger image 
10 that has been subdivided into blocks, such as the block 12 that is bounded by the block boundaries 14, 16, 18, and 

is 20. Pixels outside of the area bounded by the block boundaries are pixels included in adjacent blocks. An image edge 
22, formed by the boundaries of pixels of a first 24 and second 26 color divides the block 1 2 diagonally. It is understood 
that a block of pixels, as used herein, may be any plurality of pixels defining any pattern. 

[0011] Decompressed images may exhibit several artifacts of the compression-decompression process. The most 
prevalent artifact of compression is the blocking effect where the blocks created for image compression are visually 

20 perceptible in the decompressed image. In the DCT transform coding compression process, the spatial domain signal 
for a block is converted to a block of coefficients in the frequency domain by the application of the transform. The 
resulting frequency coefficients are quantized or approximated as one of a limited number of discrete values permitted 
by the encoder. Since large areas of an original image may be of relatively uniform color or grayscale, the "rounding 
off" process performed by the encoder may result in pixels of nearly the same original color being assigned quantized 

25 values that are visually significantly different. When the image is decompressed, the color or grayscale difference of 
the pixels may be sufficient to be noticeable. This is a particular problem at the boundaries of adjacent blocks in areas 
of relatively uniform color. The severity of the blocking effect is a function of the distance between successive potential 
quantized values or the quantization parameter selected by the encoder. Post-processing (often by filtering) may be 
applied to smooth the change across block boundaries to reduce or eliminate the blocking effect or grid noise. 

30 [0012] Filtering a segment of a horizontal row or vertical column of pixels along each boundary of each block of an 
image is a computationally resource intensive process. In addition, filtering a column or row of pixels extending to the 
center of the block 12 would result in filtering of the image edge 22. Some portions of a diagonal image edge, such as 
edge 22, may be filtered more than once. As a result, the sharpness of edges in the decompressed image will be 
degraded. The present inventor realized that computational resources can be conserved by selectively filtering pixels 

35 within selected blocks of an image where an artifact may be a problem. Further, the inventor realized that the sharpness 
of edges and, therefore, the quality of the decompressed image can be improved by selectively filtering pixels along 
an axis aligned generally parallel to the direction of an image edge. In the present invention, the direction of an image 
edge is detected and filtering is selectively applied to pixels arrayed along a filtering axis which aligned relatively parallel 
to the direction of an image edge in a block. 

40 [0013] In addition to the blocking effect, decompressed images may exhibit ringing artifacts that often appear as 
noisy lines in the vicinity of and approximately paralleling an image edge. In FIG. 1 a ringing artifact is illustrated by 
pixels of a third color 28 in the vicinity of the edge 22. A decompressed image may also exhibit "staircase, noise," a 
term which is descriptive of an appearance of an edge in the image. The staircase appearance is the result of enhance- 
ment of the blocking effect for blocks lying across an edge 22 in an image. 

45 [0014] The steps of the post-processing technique of the present invention are illustrated in FIG. 2. To avoid over 
smoothing the image and conserve computational resources, filtering is selectively applied to the pixels of selected 
blocks of the image. In a block selection step, the quantization parameter (QP) for each block is extracted from the 
data stream and compared to a predetermined quantization parameter threshold (QP_THR) 102. The quantization 
parameter threshold is a selected maximum distance between quanta that produces a visually acceptable transition 

so across the block boundary. If the quantization parameter is less than the threshold, the quantization error is not likely 
to create significant grid noise and an objectionable blocking artifact. If this is the case, the method selects the next 
block for examination 104 without filtering the current block. If the quantization parameter exceeds the quantization 
parameter threshold, the block is designated for filtering. 

[0015] If a block of pixels is to be filtered, the most dominant direction of an image edge in the block is determined 
55 1 06. The edge direction is determined by comparing pixels in the vicinity of opposing boundaries of the block and 
located on projections of candidate filtering axes. Referring again to FIG. 1 , the edge detection investigation may be 
performed in the directions of four candidate axes; horizontal (k=0) 30, vertical (k=2) 32, and the 45° diagonals (k=3) 
34 and (k=1) 36, to determine the dominant direction of the exemplary edge 22 in the block 12. The investigation could 
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proceed along different, additional or intermediate candidate axes (for example, 22.5°) but the required additional 
computation may not be justified by the improvement in the quality of the decompressed image. 
[0016] Since a block loses much of its high frequency information in the compression process, inferring the direction 
of an image edge from pixels within the block can be difficult. Examining pixels that are members of neighboring blocks 

5 and adjacent to the block boundaries 14, 16, 18, and 20 increases the area of the image subject to examination and 
improves the accuracy of the results. Corresponding pairs of pixels to be compared are located along projections 
parallel to each of the candidate axes 30, 32, 34, and 36 and in the vicinities of opposing block boundaries. For example, 
projections 38 and 40 parallel to candidate axis 36 are used to identify pixels (1 ,0) 42 and (0,1) 44 and (3,0) 46 and 
(0,3) 48 in the vicinities of block boundaries 14 and 1 8 for comparison. Sub-sampling by a factor of two has been found 

10 to produce sufficient data points to identify the dominant edge direction and reduces the computational requirements. 
As a result, five pairs of pixeis are investigated for the horizontal (k=0) 30 and vertical (k=2) 32 axes and nine pairs of 
pixels are investigated for the diagonal axes (k=1) 36 and (k=3) 34. Sub-sampling by a factor of two produces an 
exemplary data set as follows for an 8x8 block, where P k 1 and P k 2 are pixels of corresponding pairs on opposing block 
boundaries: 

15 



k 


Pk 1 


Pk 2 


0 


{(0,0), (1,0) (N+1,0)} 


{(0.N+1), (1.N+1), (N+1.N+1)} 


1 


{(0,1) (0,N+1),..(N,N+1)} 


{(1,0) (N+1,0) (N+1.N) 


2 


{(0,0), (0,1) (0.N+1)} 


{(N+1,0), (N+1,1) (N+1.N+1)} 


3 


{(0,N) (0,0),... ,(N,0)} 


{(1.N+1),..., (N+1.N+1),... (N+1,1)} 



[0017] The dominant direction of an image edge in a pixel block is identified by the candidate axis corresponding to 
the minimum sum of the mean absolute differences of the pixel values for each of the pluralities of corresponding 
pixels, selected for investigation. In other words: 



k mjn = arg MIN {0 ^ 3} IP k 1 - P k 2 l / DIM (P k 1 ) 

where: 

IP k 1 - P k 2 I/ DIM (P k 1 ) = the mean absolute difference of the corresponding pixels in the set of projection data in 
the direction of axis k 

k min = the candidate axis returning the minimum argument 

The difference between pixels at opposing boundaries on projections parallel to the edge 22 is assumed to be less 
than the differences between pixels sampled in the direction of candidate axes 30, 32, and 34 which lie on opposites 
the significant color or grayscale difference that characterizes an edge, such as edge 22. The candidate direction that 
produces the minimum sum is taken as the dominant direction of the edge 22 in the block 1 2 for the purpose of orienting 
the filtering axis for filtering the pixels of block 12. 

[0018] Following determination of the dominant image edge direction, groups of contiguous pixels 49 (V 0 . ... V 9 ) 
(filtering segments) (indicated by a bracket) bisected by the block boundary 14 and parallel to the identified edge 
direction or filtering axis are identified for selective low pass filtering 108. 

[001 9] To avoid over smoothing the image, the two pixels of the filtering segment adjacent to the block boundary (V 4 
and V 5 ) 50 and 52 are tested against two thresholds 110. First, if the absolute value of the difference between the 
pixels (V 4 and V 5 ) 50 and 52 adjacent to the block boundary 1 4 is greater than twice the quantization parameter (Q P), 
the pixels likely represent an image edge and filtering is not applied to avoid reducing the sharpness of the edge. On 
the other hand, filtering is not applied if the absolute value of the difference between pixels 50 and 52 adjacent to the 
block boundary 14 is less a predefined boundary threshold (BD_THR) because the difference between the colors or 
grayscale of the pixels is insufficient to cause a visible blocking artifact If the difference between pixels 50 and 52 of 
the filtering segment 48 adjacent to the block boundary is outside the upper and lower bounds established by these 
tests, then the next filtering segment is selected 112 without applying filtering to the current segment 
[0020] If the difference between the pixels 50 and 52 adjacent to the boundary is within the upper and lower bounds, 
filtering of the segment is warranted and the continuity of the color or grayscale along the filtering segment is checked 
1 1 4. A significant difference between adjacent pixels in a filtering segment, except at the block boundary, is a probable 
indication of a detail within the block. The purpose of the discontinuity check 114 is to detect such a variation and limit 
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filtering to a range of pixels within the segment so that filtering is not applied to the pixels representing the detail. 
Starting at V 4 50, the difference between the value of V 4 (V,) and next contiguous pixel further removed from the 
boundary (V3) 54 is compared to a threshold (THRED). Likewise, the difference between pixel V 3 54 and pixel V 2 56 
and each successive pair of pixels farther from the block boundary 14 will be compared to the threshold (THRED). If 

5 the difference for a pair of pixels exceeds the threshold (THRED), the pixel nearer the block boundary 14 is chosen 
as the lower bound to the filtering segment 49. Likewise, a discontinuity check is performed, beginning at V 5 52, to 
establish an upper bound to the segment. A filtering range comprising the portion of the filtering segment 49 including 
the pixels between the upper and lower bound produced by the discontinuity check (V LB ... V UB ) and including at least 
one pixel on each side of the boundary is filtered. The threshold may be a function of the quantization parameter (QP) 

10 and the absolute value of the difference between the pixels adjacent to the boundary (I V 4 -V 5 I). The threshold also may 
differ for blocks with different characteristics. For example, blocks might be characterized on the basis of the mean 
difference between pixels on opposing boundaries of the block as identified in the image edge direction identification 
step 108. For example, a block might be typified as: 

is (a) simple, strong edge type if: 



Min_dif = the mean absolute difference in values corresponding to k^ 

Max_dif = the mean absolute difference in values corresponding to k^ 

THR_edge 1= threshold edge 1 

THR_edge 2 = threshold edge 2 

THR_smooth = threshold of smooth transistion 

k mjn = arg lvHN {0sks3} IP k i - P R 2 I/ DIM (P k i) 

>W = ^MAX {0 ^ 3} IP k i - P k 2 I/ DIM (P k i) 

IP k 1 - P k 2 l/ DIM (P k 1 ) = the mean absolute difference of the corresponding pixels in the set of projection data 
in the direction of axis k 

k min = tne ax ' s producing the minimum argument 
k max = the axis producing the maximum argument 



For example, the threshold (THRED) might be increased to facilitate more aggressive filtering of filtering segments in 
blocks classified as possessing a simple, strong edge. The threshold (THRED) can also be set to a level sufficient to 
avoid filtering details in the block while allowing filtering of the pixels of the ringing artifact 28. Pixel repetition or sym- 
metric extension may be used for filtering pixels near the segment boundary (V LB , ... V UB ). 

40 [0021] Following determination of the filtering range, the pixels of the filtering range (V LB ... V UB ) are filtered 116 and 
the method selects the filtering segment for processing 112. Filtering is necessary only along the left vertical boundary 
14 and the lower horizontal boundary 20 of the block 12 because filtering is usually applied in the direction of the raster 
scan and the remaining block boundaries 16 and 18 are subject to filtering when the neighboring blocks are filtered. 
Any low pass filter may be used for filtering the filtering range. A seven tap filter that has been found to produce 

^5 acceptable image quality can be implemented as described in TABLE A. 

[0022] In addition, a short filter mode may also be provided for in the method of the present invention. A large variation 
in intensity for the pixels of the filtering segment 49 indicates that the segment is in an area of the image 1 0 having a 
high level of detail texture. If this is the case, the short filtering mode can be selected and the values of the two pixels 
50 and 52 adjacent to the block boundary 14 replaced by their average value to reduce the blocking effect. 

50 [0023] The method of the present invention is also useful for post-processing the image of an interlaced video field. 
Since the two fields often undergo different operations during compression (for example, motion estimation or com- 
pensation and DCT coding), it is advantageous to apply post-processing separately to the images represented by the 
individual fields. Applying post-processing separately to the fields avoids the complication of block classification and 
confusing an intensity change between fields (resulting from either field capture or compression) as an image edge. 

55 Identifying an intensity change between fields as an image edge is a particular problem at the boundaries of moving 
objects. Slightly better performance may also be possible if adaptive separation is based on the mode of compression 
of each macro-block (field or frame motion compensation). 
[0024] All the references cited herein are incorporated by reference. 



Min_dif < THR_edge 1 and 
Max.dif - Min.dif > THR_edge 2 



20 



(b) 
(c) 



smooth if: Max_dif < THR_smooth 

complex if: the relationship of Min_dif and Max_dif is otherwise 
where: 
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[0025] The terms and expressions that have been employed in the foregoing specification are used as terms of 
description and not of limitation, and there is no intention, in the use of such terms and expressions, of excluding 
equivalents of the features shown and described or portions thereof, it being recognized that the scope of the invention 
is defined and limited only by the claims that follow. 



TABLE A 
Implementation of a seven tap filter 

/*LPF7:(1 2 3 432 1)/16V 

/•v[ij: segment of Input data to be filtered 
u[fj: segment of output data 

LB, HB: lower bound and upper bound of the smaller 
segment that is actually filtered */ 
fbr(l=-3. psum=4; K=3:l++) 
{ 

if(l+LB>=0) psum+=v[l+LBl; 
else psum+=v[0]; 

} 

for(l=LB; k=H8; l<w) 
{ 

switch 0) 
{ 

case 1: 

u[1] = ({(psum + v[i]) « 1)+(v{2] - v(4])) » 4; 
psum*=v[5]-v/{0]; 
break; 
case 2: 

u0] * (((psum + v0l) « 1 )+(vpl+vf 1]) - (v[5] + v[0])) » 4; 
psum+=v[6]-v(0]; 
break; 
case 3: 

= (((psum + v(l]) « l)+(v[4J+v{2]) - (v[61 + v[0D) » 4; 
psum+^v[7]-vl0}; 
break; 
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case 4: 



5 



uffl = (((psum + v[!J) « 1 )+(v[5l+v[3]) - (v[7J + v[l])) » 4; 

psum+=v[8]-v[1]; 

break; 



case 5: 



15 



m = (((psum + v(IJ) « 1 Wv[6]+v(4]) - (vp] * v[2])) » 4; 

psum+=v[9]-v[2]; 

break; 



case 6: 



uffl = (((psum + vffl) « 1Mv[7)+vf5J) - (v(9] + vpj}) » 4; 
psum+*v[9]-v(3]; 
break: 
case 7: 

uflj * (((psum + vpj) « 1 Mv[8]+v[6]) • (v[9J + v[4J)) » 4; 
psum+=v[91-v[4J; 
break; 
case 8: 

up] = (((psum + vpj) « D+(v[7K5])>» 4; 
break; 

} 



1. A method of post-processing a decompressed image (10) comprising the steps of: 

(a) establishing a filtering axis (36) aligned relatively parallel to an image edge (22) in a block (12) of image 
pixels; and 

(b) selectively filtering a plurality of pixels arrayed substantially parallel to said filtering axis (36). 

2. The method of claim 1 wherein the step of establishing said filtering axis comprises the steps of: 

(a) an identifying step for identifying a first pixel (42, 46) and a second pixel (44, 48) located on a projection 
parallel to a candidate axis (36); said first pixel located in a vicinity of a first boundary (14) of said block and 
said second pixel located in a vicinity of a second boundary (18); 

(b) a comparing step for comparing said first and said second pixel; 

(c) repeating the identifying step and the comparing step for a plurality of said candidate axes (30, 32, 34, 36); 



(d) designating as said filtering axis (36) said candidate axis (36) associated with a comparison of said first 
and said second pixels ((42, 46), (44, 48)) having a predefined relationship to corresponding comparisons for 
other said candidate axes. 



) 
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3. The method of claim 2 wherein said relationship between said comparisons is a minimum of a mean of a difference 
between a plurality of said first and said second pixels (42, 46) identified in connection with a candidate axis (36). 

4. The method of claim 1 wherein the step of selectively filtering a plurality of pixels arrayed substantially parallel to 
said filtering axis comprises the steps of: 

(a) designating a segment (49) of contiguous pixels to be subject to filtering if a comparison of a pair of pixels 
(50, 52) of said segment immediately adjacent to a boundary (1 4) of said block (1 2) satisfies a predetermined 
relationship; and * 

(b) selectively filtering said pixels of said segment (49). 

5. The method of claim 4 wherein said predetermined relationship comparing said pair of pixels (50, 52) adjacent to 
said boundary (1 4) comprises a upper boundary threshold for a difference between said pair of pixels (50, 52). 

6. The method of claim 4 wherein said predetermined relationship for comparing said pair of pixels (50, 52) adjacent 
to said boundary (14) comprises a lower threshold for a difference between said pair of pixels. 

7. The method of claim 6 wherein said lower threshold comprises a function of a quantization parameter applicable 
to said block (12). 

8. The method of claim 1 wherein the step of selectively filtering a plurality of pixels arrayed substantially parallel to 
said filtering axis comprises the steps of: 

(a) designating a segment (49) of contiguous pixels to be subject to filtering if a comparison of a pair of pixels 
(50, 52) of said segment immediately adjacent to a boundary (14) of said block (12) satisfies a predetermined 
relationship; 

(b) identifying at least one pixel on each side of said boundary (14) as a filtering range by successively com- 
paring contiguous pairs of pixels further removed from said boundary to a continuity threshold; and 

(c) filtering said pixels of said filtering range. 

9. A method of post processing a decompressed image comprising the steps of: 

(a) selecting a block of image pixels for filtering as a function of a quantization parameter and a quantization 
parameter threshold; 

(b) establishing a filtering axis (36) relatively parallel to an image edge (22) in said block (12); 

(c) identifying a filtering segment (49) comprising a plurality of contiguous pixels arrayed substantially parallel 
to said filtering axis and intersected by a boundary (14) of said block (12); and 

(d) selectively filtering said pixels of said filtering segment (49). 

10. The method of claim 9 wherein the step of establishing a filtering axis relatively parallel to an image edge in said 
block comprises the steps of: 

(a) designating a plurality of candidate axes (30, 32, 34, 36); 

(b) an identifying step for identifying a first pixel (42, 46) and a second pixel (44, 48) located on a projection 
parallel to a candidate axis (36), said first pixel located in a vicinity of a first boundary of said block and said 
second pixel located in a vicinity of a second boundary; 

(c) a determining step for determining a difference between said first pixel and said second pixel; 

(d) repeating the identifying step and the determining step for said plurality of candidate axes (30, 32, 34, 36); 

(e) identifying as said filtering axis (36) said candidate axis (36) corresponding to a function of a minimum 
difference between said first and said second pixels ((42, 46), (44, 48)). 

11. The method of claim 9 comprising the further step of designating said filtering segment (49) subject to filtering if 
a pair of pixels (50, 52) of said filtering segment adjacent to said boundary (14) satisfies a predetermined relation- 
ship to a threshold. 

12. The method of claim 11 wherein the step of designating said filtering segment (49) subject to filtering a pair of 
pixels (50, 52) of said filtering segment (49) adjacent to a boundary (1 4) of said block (1 2) satisfies a predetermined 
relationship to a threshold comprises the steps of: 



8 



45 



# 



EP1 146 748 A2 



(a) comparing a difference between said pair of pixels (50, 52) to an upper boundary threshold; and 

(b) comparing said difference between said pair of pixels (50, 52) to a lower boundary threshold. 

13. The method of claim 12 wherein said lower boundary threshold is a function of a quantization parameter for said 
5 block (12). 

14. The method of claim 9 comprising the further steps of: 

(a) designating at least one pixel (50, 52) on each side of said boundary (14) as a filtering range; and " 
10 (b) filtering said pixels (50, 52) of said filtering range. 

15. The method of claim 14 wherein the step of designating at least one pixel on each side of said boundary (14) as 
a filtering range comprises the steps of: 

15 (a) selecting a pixel of said filtering segment (49) adjacent to said boundary (1 4) for inclusion in said filtering 

range; and 

(b) successively including in said filtering range a next contiguous pixel until a difference between a last pixel 
included in said filtering range and said next contiguous pixel exceeds a continuity threshold. 

20 16. The method of claim 15 wherein said continuity threshold is a function of a quantization parameterfor said block 
(12). 

17. The method of claim 1 5 wherein said continuity threshold is a function of a difference between a first pixel (42, 46) 
located in a vicinity of a first boundary (14) of said block (1 2) and a second pixel (44, 48) located in a vicinity of an 

25 opposing second boundary (18) of said block (12). 

18. A method of post processing a decompressed image comprising the steps of: 

(a) identifying a block (12) of image pixels defined by a block boundary; 
30 (b) comparing a quantization parameter applicable to said block (12) to a threshold quantization parameter; 

(c) selecting a pixel pair arrayed on each of a plurality of projections (38, 40) parallel to a plurality of candidate 
filtering axes (30, 32, 34, 36), if said block quantization parameter exceeds said threshold quantization pa- 
rameter; 

(d) summing the mean difference between pixels of said pixel pair ((42, 44), (46, 48)) for each of said plurality 
35 of projections (38, 40) for each of said candidate filtering axes (30, 32, 34, 36); 

(e) selecting said candidate filtering axis (36) corresponding to a least of said sum of said difference between 
pixels of said pixel pair ((42, 44), (46, 48)) as a filtering axis (36); 

(f) identifying a filtering segment (49) comprising a plurality of filtering segment pixels arrayed in a direction 
parallel to said filtering axis; 

40 (g) identifying a filtering range comprising at least one said filtering segment pixel on each side of said block 

boundary y (14); and 

(h) filtering said filtering segment pixels of said filtering range to smooth said decompressed image. 



19. The method of claim 1 8 further comprising the steps of: 



(a) a comparing step for comparing a difference between pixels of a contiguous filtering segment pixel pair 
(50, 52) to a continuity threshold; 

(b) repeating the comparing step for filtering segment pixel pairs located successively more remote from said 
block boundary (14) until said difference exceeds said continuity threshold; and 

50 (c) limiting said filtering range to an array of successively more remote filtering segment pixels on each side 

of said block boundary (14); each pixel being a member of a filtering segment pixel pair 

characterized by said difference being less said continuity threshold. 

55 20. A method of post-processing interlaced video comprising the steps of: 

(a) establishing a filtering axis aligned relatively parallel to an edge in a block of pixels of a first interlaced field; 

(b) selectively filtering a plurality of pixels of said block of said first interlaced field arrayed substantially parallel 
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to said filtering axis; 

(c) establishing a filtering axis aligned relatively parallel to an edge in a block of pixels of a second interlaced 
field; and 

(d) selectively filtering a plurality of pixels of said block of said second field arrayed substantially parallel to 
said filtering axis. 

21. The method of claim 20 wherein the step of establishing said filtering axis comprises the steps of: 

(a) an identifying step for identifying a first pixel and a second pixel located on a projection parallel to a can- 
didate axis; said first pixel located In a vicinity of a first boundary of a block and said second pixel in a vicinity 
of a second boundary of said block; 

(b) a comparing step for comparing said first and said second pixel; 

(c) repeating the identifying step and the comparing step for a plurality of said candidate axes; and 

(d) designating as said filtering axis said candidate axis associated with a comparison of said first and said 
second pixel having a predefined relationship to corresponding comparisons for other said candidate axes. 

22. The method of claim 21 wherein said relationship between comparisons is a minimum of a difference between 
said first and said second pixel. 

23. The method of claim 20 wherein the step of selectively filtering a plurality of pixels arrayed substantially parallel 
to said filtering axis comprises the steps of: 

(a) designating a segment of contiguous pixels to be subject to filtering if a comparison of a pair of pixels of 
said segment immediately adjacent to a boundary of said block satisfies a predetermined relationship; and 

(b) selectively filtering said pixels of said segment. 

24. The method of claim 23 wherein said predetermined relationship comparing said pair of pixels adjacent to said 
boundary comprises a upper boundary threshold for a difference between said pair of pixels. 

25. The method of claim 23 wherein said predetermined relationship for comparing said pair of pixels adjacent to said 
boundary comprises a lower threshold for a difference between said pair of pixels. 

26. The method of claim 25 wherein said lower threshold comprises a function of a quantization parameter applicable 
to said block. 

27. The method of claim 23 wherein the step of selectively filtering a plurality of pixels arrayed substantially parallel 
to said filtering axis comprises the steps of: 

(a) designating a segment of contiguous pixels to be subject to filtering if a comparison of a pair of pixels of 
said segment immediately adjacent to a boundary of said block satisfies a predetermined relationship; 

(b) identifying at least one pixel on each side of said boundary as a filtering range by successively comparing 
contiguous pairs of pixels further removed from said boundary to a continuity threshold; and 

(c) filtering said pixels of said filtering range. 



10 



/A EP 1 146 748 A2 



FIG.1 
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